Coordinated deep tagging of media content with community chat postings

ABSTRACT

Embodiments of the present invention address deficiencies of the art in respect to deep tagging of media content and provide a method, system and computer program product for coordinating deep tagging of media content with chat postings. In an embodiment of the invention, a method for coordinating deep tagging of media content with chat postings can be provided. The method can include monitoring a group chat of participants co-browsing media content, identifying a token in the group chat appearing a threshold number of times within a temporal window, and creating a deep tag in the media content in association with a portion of the media content played back concurrently with the temporal window.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to the field of content tagging in acomputer communications network and more particularly to deep tagging ofmedia content.

2. Description of the Related Art

Xanadu, the progenitor of the World Wide Web and the Internet intendedupon a means for providing self-service distribution of content tointerested parties across the globe. The World Wide Web (Web) as thesuccessor to Xanadu, through its adoption of a standardized markuplanguage and corresponding content browser specification, advanced thenotion of content distribution to its present high efficient form. Soeffective was the Web in bringing content to the masses that an unwieldyvolume of content rapidly published through the Web far ahead of anymechanism to locate and index desired content. The search engineeventually filled this void resulting in an effective way for users toseek out and view massive quantities of content on demand.

Content indexing associated with search engine technology relies upon anautomated classification of content irrespective of the subjectiveperspective of the Web community. Second generation technologies addressthe socialization of content distribution about the Internet bypersonalizing the characterization and indexing of content. Indeedsecond generation technologies provide a wholly different way ofindexing and locating content dependent upon the social relationshipsbetween end users. Exemplary second generation technologies includesocial networking portals, co-browsing environments, and socialbookmarking systems.

Social bookmarking refers to the collective location andcharacterization of content of interest. In a social bookmarking system,different users can tag content of interest and the tags applied by themembers of a social bookmarking community can be applied to content asit is distributed to other members. Indeed even the presentation ofcontent that has been tagged can vary according to the volume of tagsapplied to the content by the members of the social bookmarkingcommunity. In all instances, however, a member of the social communitymust locate content of interest and apply a tag to the content ofinterest such that subsequent members viewing the content of interestcan enjoy the context provided by the tag.

The notion of tagging initially had been associated with traditional Webcontent—namely Web pages. Tagging, however, has expanded its reach toinclude fully motion video and audio and other types of Webdistributable content. In audio and video, specifically, deep tags canbe applied to portions of media content such as audio or video so thatan end user can skip to the deeply tagged portions during playback.Thus, deep tagging has become an organizational tool for Webdistributable media content. Additionally, deep tagging providessocially acceptable context for members of a social network providingthe deep tags. Still, applying deep tags to media content can bechallenging as end users tediously must recall a desired portion ofmedia content and navigate to that portion during playback in order toapply a deep tag.

BRIEF SUMMARY OF THE INVENTION

Embodiments of the present invention address deficiencies of the art inrespect to deep tagging of media content and provide a novel andnon-obvious method, system and computer program product for coordinatingdeep tagging of media content with chat postings. In an embodiment ofthe invention, a method for coordinating deep tagging of media contentwith chat postings can be provided. The method can include monitoring agroup chat of participants co-browsing media content, identifying atoken in the group chat appearing a threshold number of times within atemporal window, and creating a deep tag in the media content inassociation with a portion of the media content played back concurrentlywith the temporal window.

In one aspect of the embodiment, the method further can include trackinga number of participants contributing token, linking the number with thedeep tag, and rendering a tag cloud for the deep tag in association withthe portion of the media content according to the linked number. Inanother aspect of the embodiment, the method further can includefiltering a set of tokens from the group chat relating to articles ofspeech such as a set of tokens from the group chat relating toundesirable speech such as foul language, sexually explicit language oroffensive language.

In yet another aspect of the embodiment, the method further can includecreating a broad tag in connection with the token when the token hasbeen contributed a threshold number of times indicating widespreadusage. In even yet another aspect of the embodiment, the method furthercan include displaying to each of the participants a listing of deeptags applied to a portion of the media content being played back toprovide cues for word usage in the group chat. In a final aspect of theembodiment, the method further can include speech recognizing audiblydetectable user reactions to the media content to produce the tokenmapped to the audibly detectable user reactions.

In another embodiment of the invention, a co-browsing data processingsystem can be provided. The system can include a media content serverconfigured to stream media content such as video or audio (or both) todifferent clients over a computer communications network and a chatserver configured to host a group chat amongst the clients. The systemfurther can include social deep tagging logic. The logic can includeprogram code enabled to monitor the group chat, to identify a token inthe group chat appearing a threshold number of times within a temporalwindow, and to create a deep tag in the media content in associationwith a portion of the media content played back concurrently with thetemporal window.

Additional aspects of the invention will be set forth in part in thedescription which follows, and in part will be obvious from thedescription, or may be learned by practice of the invention. The aspectsof the invention will be realized and attained by means of the elementsand combinations particularly pointed out in the appended claims. It isto be understood that both the foregoing general description and thefollowing detailed description are exemplary and explanatory only andare not restrictive of the invention, as claimed.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute partof this specification, illustrate embodiments of the invention andtogether with the description, serve to explain the principles of theinvention. The embodiments illustrated herein are presently preferred,it being understood, however, that the invention is not limited to theprecise arrangements and instrumentalities shown, wherein:

FIG. 1 is a pictorial illustration of a process for coordinating deeptagging of media content with chat postings;

FIG. 2 is a schematic illustration of a multimedia co-browsing dataprocessing system configured for coordinating deep tagging of mediacontent with chat postings; and,

FIG. 3 is a flow chart illustrating a process for coordinating deeptagging of media content with chat postings.

DETAILED DESCRIPTION OF THE INVENTION

Embodiments of the present invention provide a method, system andcomputer program product for coordinating deep tagging of media contentwith chat postings. In accordance with an embodiment of the presentinvention, members of a social network can co-browse media content, suchas audio or video. A group chat can be established and maintained asbetween the members concurrently with co-browsing the media content. Thepostings of the group chat can be parsed to identify tokens usedcommonly and repeatedly amongst the members within a threshold span oftime. Once a token such as a word or symbol has been used commonly by athreshold number of members within a threshold span of time, thecommonly used token can be applied as a deep tag to the portion of themultimedia played back during the span of time. In this way, sociallyrelevant context can be applied to the media content as a deep tagwithout requiring a tedious manual deep tagging of the media content.

In further illustration, FIG. 1 is a pictorial illustration of a processfor coordinating deep tagging of multimedia content with chat postings.As shown in FIG. 1, multiple different collaborators 110 canconcurrently browse media content 120, for example video or audio orboth. Specifically, each of the different collaborators 110 can view theplayback of the same media content 120 at substantially the same time,hereinafter referred to as co-browsing the media content 120.Concurrently, the collaborators 110 can engage in a group chat 130.During a window of time 140, the words and symbols appearing in thegroup chat 130 can be analyzed to identify a token provided by multipledifferent ones of the collaborators 110 during the window of time 140.In response, a deep tag 150 with the identified token can be applied tothe portion of the media content 120 played back at the time of theidentification.

The process of FIG. 1 can be embodied within a media co-browsing dataprocessing system. In further illustration, FIG. 2 is a schematicillustration of a media content co-browsing data processing systemconfigured for coordinating deep tagging of multimedia content with chatpostings. The system can include multiple different clients 210communicatively coupled to a host server 230 over computercommunications network 220. The host server 230 can be coupled to both achat server 240 and also a media server 250 streaming media content 270to the different clients 210 over the computer communications network220 for viewing in a media co-browser 260 executing in each of theclients 210 (only a single media co-browser 260 shown for the purpose ofillustrative simplicity).

Social deep tagging logic 300 can be coupled to each of the chat server240 and the media server 250 through host server 230 and further to adata store of deep tags 280 applied to portions of the media content270. The social deep tagging logic 300 can include program code enabledto detect commonly used tokens in a group chat within a threshold windowof time. Alternatively, the social deep tagging logic 300 can includeprogram code enabled to detect common emotions provided by biometricmonitoring systems in each of the clients 210. The program code of thesocial deep tagging logic 300 further can be enabled to create a deeptag in the data store of deep tags 280 for concurrently played backportions of the media content 270 using the commonly used tokens fromthe group chat appearing within the threshold window of time during theconcurrent playback of the media content 270. In this way, sociallyrelevant deep tags can be automatically applied to portions of the mediacontent 270 without requiring a tedious manual application of the deeptags.

In yet further illustration of the operation of the social deep tagginglogic 300, FIG. 3 is a flow chart illustrating a process forcoordinating deep tagging of multimedia content with chat postings.Beginning in block 310, a temporal window of time can be establishedsuch as a few seconds or a few minutes. In block 320, media content,such as audio or video, can be played back for viewing within mediabrowsers in multiple different clients over a computer communicationsnetwork. Concurrently, a group chat can be established in the differentclients, either as part of a co-browser application or as a separateapplication and in block 330, the chat postings from the differentclients can be received for processing.

In block 340, a chat posting can be parsed into a sequence of tokens andin block 350, the tokens can be stored in association with a time stamp.In block 360, the stored tokens can be compared to other stored tokensto identify those of the tokens which have been included as part ofpostings by a threshold number of the clients during the establishedtemporal window. In decision block 370, it can be determined if any ofthe tokens match. Alternatively, it can be determined if any of thetokens pre-determined to be “similar” or “analogous” as specified in atable. If so, in block 380 a deep tag can be created with the matchingtoken for a portion of the media content played back during the temporalwindow. In either case, however, in block 390 those of the stored tokensthat have fallen out of the temporal window can be expired and purgedfrom storage so that only tokens contributed during the temporal windowremain. Thereafter, the process can repeat for a next chat posting inblock 330.

Notably, in one aspect of the embodiment, the number of clientscontributing the same token can be tracked and associated with the deeptag so that when rendered, a tag cloud can be provided. In anotheraspect of the embodiment, a set of token filters can be provided tofilter out certain articles unlikely to relate to the media content, aswell as undesirable tokens such as foul language or explicit oroffensive words. In yet another aspect of the embodiment, when a tokenhas been contributed a threshold number of times indicating widespreadusage, a broad tag instead of a deep tag can be generated. In even yetanother aspect of the embodiment, a listing of the deep tags applied toa portion of media content being played back can be displayed to thecollaborators to provide cues for word usage in the group chat. In afinal aspect of the embodiment, speech recognized tokens can be providedfor audibly detectable user reactions such as laughter or gasping. Inparticular, the detected user reactions can be mapped to a preset tokensuch as “funny” or “scary”.

Embodiments of the invention can take the form of an entirely hardwareembodiment, an entirely software embodiment or an embodiment containingboth hardware and software elements. In a preferred embodiment, theinvention is implemented in software, which includes but is not limitedto firmware, resident software, microcode, and the like. Furthermore,the invention can take the form of a computer program product accessiblefrom a computer-usable or computer-readable medium providing programcode for use by or in connection with a computer or any instructionexecution system.

For the purposes of this description, a computer-usable or computerreadable medium can be any apparatus that can contain, store,communicate, propagate, or transport the program for use by or inconnection with the instruction execution system, apparatus, or device.The medium can be an electronic, magnetic, optical, electromagnetic,infrared, or semiconductor system (or apparatus or device) or apropagation medium. Examples of a computer-readable medium include asemiconductor or solid state memory, magnetic tape, a removable computerdiskette, a random access memory (RAM), a read-only memory (ROM), arigid magnetic disk and an optical disk. Current examples of opticaldisks include compact disk—read only memory (CD-ROM), compactdisk—read/write (CD-R/W) and DVD.

A data processing system suitable for storing and/or executing programcode will include at least one processor coupled directly or indirectlyto memory elements through a system bus. The memory elements can includelocal memory employed during actual execution of the program code, bulkstorage, and cache memories which provide temporary storage of at leastsome program code in order to reduce the number of times code must beretrieved from bulk storage during execution. Input/output or I/Odevices (including but not limited to keyboards, displays, pointingdevices, etc.) can be coupled to the system either directly or throughintervening I/O controllers. Network adapters may also be coupled to thesystem to enable the data processing system to become coupled to otherdata processing systems or remote printers or storage devices throughintervening private or public networks. Modems, cable modem and Ethernetcards are just a few of the currently available types of networkadapters.

1.-19. (canceled)
 20. A computer processor implemented method forcoordinating deep tagging of media content with chat postings, themethod comprising: receiving chat postings from participants ondifferent client computing devices participating in a group chat as eachof the participants on the different client computing devicesconcurrently view media content; parsing the chat postings into asequence of tokens; storing the sequence of tokens in association with atime stamp; identifying at least one token of the sequence of tokensincluded as part of the chat postings a threshold number of times by athreshold number of the participants from the different client computingdevices during a temporal window; determining whether the identified atleast one token matches a different token also identified as beingincluded as part of the chat postings the threshold number of times bythe threshold number of the participants from the different clientcomputing devices during the temporal window; and, creating a deep tagwith a matching token in response to determining that the identified atleast one token matches the different token.
 21. The computer processorimplemented method of claim 20, wherein identifying the at least one ofthe sequence of tokens included as part of the chat posting thethreshold number of times by the threshold number of the participantsfrom the different client computing devices during the temporal windowcomprises comparing the stored sequence of tokens.
 22. The computerprocessor implemented method of claim 20, wherein the temporal window isa portion of time the group chat between the participants on thedifferent client computing devices lasts.
 23. The computer processorimplemented method of claim 20, further comprising: applying the deeptag with the matching token in the media content in association with aportion of the media content played back concurrently with the temporalwindow.
 24. The computer processor implemented method of claim 20,further comprising: determining whether ones of the stored sequence oftokens have fallen out of the temporal window; and, purging the ones ofthe stored sequence of tokens determined to have fallen out of thetemporal window from storage.
 25. The computer processor implementedmethod of claim 20, wherein determining whether the identified at leastone token matches the different token further comprises determiningwhether the identified at least one token matches a token on a table,where the token on the table is predetermined to be a match.
 26. Aco-browsing data processing system, comprising: a media content serverstreaming media content to different client computing devices over acomputer communications network; a chat server hosting a group chatamongst the different client computing devices; a host server having atleast one processor and a memory, the host server coupled to the mediacontent server and also the chat server; and, social deep tagging logicexecuting in the memory of the host server, the social deep tagginglogic comprising program code that when executed causes the at least oneprocessor of the host sever to: receive chat postings from participantson the different client computing devices participating in the groupchat as each of the participants on the different client computingdevices concurrently view media content, parse the chat postings into asequence of tokens, store the sequence of tokens in association with atime stamp, identify at least one token of the sequence of tokensincluded as part of the chat postings a threshold number of times by athreshold number of the participants from the different client computingdevices during a temporal window, determine whether the identified atleast one token matches a different token also identified as beingincluded as part of the chat postings the threshold number of times bythe threshold number of the participants from the different clientcomputing devices during the temporal window, and create a deep tag witha matching token in response to determining that the identified at leastone token matches the different token.
 27. The system of claim 26,wherein the social deep tagging logic comprising program code that whenexecuted causes the at least one processor of the host sever to identifythe at least one of the sequence of tokens included as part of the chatposting the threshold number of times by the threshold number of theparticipants from the different client computing devices during thetemporal window comprises computer program code that when executedcauses the at least one processor of the host server to compare thestored sequence of tokens.
 28. The system of claim 26, wherein thetemporal window is a portion of time the group chat between theparticipants on the different client computing devices lasts.
 29. Thesystem of claim 26, wherein the social deep tagging logic furthercomprises program code that when executed causes the at least oneprocessor of the host sever to apply the deep tag with the matchingtoken in the media content in association with a portion of the mediacontent played back concurrently with the temporal window.
 30. Thesystem of claim 26, wherein the social deep tagging logic furthercomprises program code that when executed causes the at least oneprocessor of the host sever to: determine whether ones of the storedsequence of tokens have fallen out of the temporal window; and, purgethe ones of the stored sequence of tokens determined to have fallen outof the temporal window from storage.
 31. The system of claim 26, whereinthe social deep tagging logic comprising program code that when executedcauses the at least one processor of the host sever to determine whetherthe identified at least one token matches the different token furthercomprises program code that when executed causes the at least oneprocessor of the host server to determine whether the identified atleast one token matches a token on a table, where the token on the tableis predetermined to be a match.
 32. A computer program productcomprising a non-transitory computer usable storage medium having storedtherein computer usable program code for coordinating deep tagging ofmedia content with chat postings, the computer usable program code,which when executed by a computer hardware device, causes the computerhardware device to: receive chat postings from participants on differentclient computing devices participating in a group chat as each of theparticipants on the different client computing devices concurrently viewmedia content; parse the chat postings into a sequence of tokens; storethe sequence of tokens in association with a time stamp; identify atleast one token of the sequence of tokens included as part of the chatpostings a threshold number of times by a threshold number of theparticipants from the different client computing devices during atemporal window; determine whether the identified at least one tokenmatches a different token also identified as being included as part ofthe chat postings the threshold number of times by the threshold numberof the participants from the different client computing devices duringthe temporal window; and, create a deep tag with a matching token inresponse to determining that the identified at least one token matchesthe different token.
 33. The computer program product of claim 32,wherein the computer usable program code, which when executed by thecomputer hardware device, causes the computer hardware device toidentify the at least one of the sequence of tokens included as part ofthe chat posting the threshold number of times by the threshold numberof the participants from the different client computing devices duringthe temporal window comprises computer usable program code that whenexecuted causes the computer hardware device to compare the storedsequence of tokens.
 34. The computer program product of claim 32, thetemporal window is a portion of time the group chat between theparticipants on the different client computing devices lasts.
 35. Thecomputer program product of claim 32, wherein the computer usableprogram code further comprises computer usable program code that whenexecuted causes the at least one processor of the hardware device toapply the deep tag with the matching token in the media content inassociation with a portion of the media content played back concurrentlywith the temporal window.
 36. The computer program product of claim 32,wherein the computer usable program code further comprises computerusable program code that when executed causes the at least one processorof the hardware device to: determine whether ones of the stored sequenceof tokens have fallen out of the temporal window; and, purge the ones ofthe stored sequence of tokens determined to have fallen out of thetemporal window from storage.
 37. The computer program product of claim32, wherein the computer usable program code, which when executed by thecomputer hardware device, causes the computer hardware device todetermine whether the identified at least one token matches thedifferent token further comprises computer usable program code that whenexecuted causes the computer hardware device to determine whether theidentified at least one token matches a token on a table, where thetoken on the table is predetermined to be a match.